Skip to content

feat(plugins): unify realtime device viewers for Codex and WorkBuddy - #101

Merged
HarveySang merged 1 commit into
mainfrom
codex/unified-realtime-device-wall
Sep 16, 2026
Merged

HarveySang merged 1 commit into
mainfrom
codex/unified-realtime-device-wall

Conversation

@HarveySang

Copy link
Copy Markdown
Collaborator

Summary

Codex and WorkBuddy now open a real-time Android viewer beside the chat and require a visible decoded video frame before the first observation or action. Viewing continues after the control task ends and releases video resources when the last viewing page closes.

  • Add independent viewer lifecycles, shared scrcpy 4.1 H.264 streams, bounded buffering/reconnection, and device-bound first-frame receipts in each plugin.
  • Integrate native host opening through Skills, preserve task/device isolation and action safeguards, and fix WorkBuddy 5.5.3 Hook input binding compatibility.
  • Prepare video resources during installation, retain recovery records, and update candidate versions to Codex 0.2.0 / protocol 3 and WorkBuddy 0.3.0 / protocol 8. DSH is unchanged.

Validation

  • Re-run before submission: Codex pnpm check — 80 tests, build and validation passed.
  • Re-run before submission: WorkBuddy npm run check — 138 tests, build and validation passed.
  • Implementation-stage evidence includes real H.264 browser tests, four synthetic streams over 30 minutes, installer checks, and limited native Codex / domestic WorkBuddy phone checks. These are distinct evidence scopes, not full final-package acceptance.
  • Detailed results and limitations: candidate acceptance record.

Remaining acceptance — draft

Real overseas WorkBuddy, two-phone isolation, phone rotation / frame rate / end-to-end latency, real-device 30-minute stability, complete host stop/reconnect/restart combinations, and Codex installed Skill discovery / real downgrade remain unverified. The final decoder-reset change passed browser tests but has not been reinstalled and retested in WorkBuddy; the final package has not repeated the complete 30-minute soak.

No phone is currently available, so hardware acceptance is paused. Candidate packages were produced locally; this PR does not publish packages or claim release readiness.

@HarveySang
HarveySang marked this pull request as ready for review September 16, 2026 14:47
@HarveySang
HarveySang merged commit b7fc7ae into main Sep 16, 2026
18 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant